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A Digital System and Method for Testing Analogue and 
Mixed-Signal Cxrcuits or Systems 

FIELD OF THE XNVENTION 

5 The present invention relates to a digital system and 

method for testing of analogrue and mixed-signal (analogpue 
and digital) circuits or systems. 

BACKGROUND OF THE XNVENTXOn 

10 Testing of circuits is an essential step in the 

manufacture of high quality and reliable electronic 
products. The cost of an electronic product is related to 
the cost of the tests and the time necessary to generate 
and apply these. In terms of testing, mixed analogue and 
15 digital circuits, so called mixed-signal circuits, can be 
particularly time consuming and costly. Indeed, it has 
been reported that one of the greatest challenges in the 
coming years is the development of low-cost automatic test 
equipment for testing mixed-signal integrated circuits, 
20 see International Technology Roadmap for Semiconductors", 
1999, published by the Semiconductor Industry Association 
(SIA) . 

Analogue signals are continuous as a function of both 
time and amplitude. Therefore the amount of information to 
25 be processed during testing is potentially very large. 
Unlike digital systems, interpreting whether an analogue 




output signal does or does not actually indicate a fault 
can be ambiguous. This inability to discriminate is made 
worse by the greater functionality and complexity of even 
the sinqplest analogue circuit, particularly if input 
5 signals are limited in complexity or time duration. In 
addition, because output signals are analogue, there can 
be no ideal performance from a completely "correct" 
circuit, .Instead all assessment must be based on the 
concept that each component is. subject to tolerances, 
10 which contribute towards variability in system behaviour 
even tinder fault-free conditions. All of these features 
make the testing of analogue circuits somewhat 
problematic . 

One of the main problems with testing mixed-signal 
15 circuits is the need for separate analogue and digital 
test instruments. Over the past few years, a number of 
approaches have been proposed to unify the test method for 
mixed-signal systems. These approaches include power 
supply monitoring, digital modelling of analogue circuits 
20 and the use of digital test signals. 

As regards the use of digital signals, a number of 
techniques have been proposed, for example step response 
testing. This is described by Souders et al in the 
article ''Accurate Frequency Response Deteinninations from 
25 Discrete Step Response Data", IEEE-Trans. on 
Instrumentation and Measurement, Vol. IM-36, No. 2, pp. 433- 
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9, June 1987. Testing using a coicqplementary signal set is 
another proposed method for digital testing of analogue 
circuits. This is described by Eckersall et al in the 
article '^Testing an Analogue Circuit using a Cortplementary 
Signal Set", lEE Colloquium on Testing- Mixed Signal 
Circuits", Digest No, 1992/118, pp. 5/1-5/6, 1992. 
Pseudorandom testing is yet another option. Examples of 
this are described by: a) Al-Qutayri et al in ^^Go/No-Go 
Testing of Analogue Macros^, lEE Proc. Circuits, Devices 
and Systems, Vol. 139, No. 4, pp. 534-540, Aug. 1992; b) 
Pan et al in Pseudorandom Testing for Mixed-Signal 
Circuits", IEEE Trans. on Computer-Aided Design of 
Integrated Circuits and Systems, Vol. 18, No, 10, pp. 
1173-1185, Oct. 1997, and c) Variyara et al in "Digital- 
Compatible BIST for Analog Circuits Using Transient 
Response Sampling", IEEE Design & Test of Computers, pp. 
106-115, iJuly-Sep. 2000. 

Existing digital approaches for testing mixed-signal 
systems have had limited success. Nevertheless, because 
of the advantages of using a digital signal to test mixed- 
signal circuits, significant and continuing efforts are 
being made to investigate this. However, despite extensive 
research, a satisfactory solution to the problem of how to 
test analogue and/or mixed-signal circuits using a digital 
signal has not been found. 




f An object of the invention is to provide an improved 

method and system for digital testing of analogue and 
mixed-signal circuits. 

5 SUMMARY OF THE XNVENTXON 

The invention is based on the realisation that the 
specific nature of the digital test signal applied to an 
analogue or mixed signal circuit is key to successful 
testing. Hence, the test signal must be carefully 
10 optimised on a per circuit basis in order to ensure that 
faults can be detected quickly and accurately. Once the 
optimised test signal is obtained, a very simple set up 
can be used in the test application mode, during which 
real circuits are tested. It is envisaged that the real- 
15 time testing of circuits during manufacture would be 
automated. 

According to a first aspect of the present invention, 
there is provided a method of optimising a digital test 
signal for testing an analogue or mixed-signal circuit. 

20 The optimisation process aims to identify or design the 
optimum digital signals for use in the testing method, 
such that all or at least most of the defects that may 
occur during manufacture stage can be robustly identified. 
The method comprises determining a figure of merit that is 

25 indicative of potential differences between output 
responses of a fault free and a known faulty circuit to a 
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digital input signal; varying the input digital signal; 
calculating a figure of merit using the output responses 
of the fault free and the known faulty circuit to the 
varied input signal; and selecting an optimijin test signal 
5 based on the determined figxires of merit. The method is 
implemented using a con^uter-based simulation of the fault 
free and faulty circuits. Preferably, the selected input 
signal has a maximum figure of merit. Preferably, the 
process of varying is repeated a plurality of times, 
) thereby to determine the best variation of the initial 
test signal. Preferably the signal is varied according to 
pre-determined criteria. 

By appropriately selecting, for example by maximising 
the figure of merit, an optimum digital test signal can be 
found for identifying circuits that have the known fault. 

The method may involve testing a range of different 
initial starting input digital test signals, each of these 
being varied as set out above to find a local optimum. 
Once this is done, the method may then further involve 
coit^paring all of the local optima and their corresponding 
figures or merit and selecting the signal with the best 
overall figure of merit. 

The figure of merit may be determined using analogue 
outputs for each of the fault free and the known faulty 
circuit. An advantage of using the analogue response is 
that it naturally guides the search for a test signal 



I towards an optimuia value. The figure of merit that is 

derived from the analogue responses contains information 
about potential improvements in the digital figure of 
merit that is used in the actual test mode. A further 
5 advantage is that the analogue figure of merit is 
relatively immune to the effects of noisy or veary small 
responses. Prior to determining the figure of merit, the 
analogue signal may be processed to prevent domination of 
large differences in the output- This avoids the 
10 optimisation increasing further any instemtaneous values 
of difference in amplitude between the two analogue 
signals once that difference is sufficiently large to 
provide adequate discrimination. This can be achieved by 
applying to the signal a function having an output that 
15 saturates at two different predetermined values (often -1 
and +1) for extreme negative emd positive values of input. 
In between these saturation regions, the function should 
increase monotonically, and hence be single- valued. An 
example of a suitable fionction is the sigmoidal function, 
20 which employs a non-linear squashing function based on the 
sigrmoid or logistic equation. More specifically, the 
hyperbolic tan function (tanh) may be used. 

Additionally or alternatively, the suialogue signal 
may be processed to take into account acceptable 
25 variations in the output caused by device tolerances . 



V The figure of merit may be determined using digital 

outputs from the circuit under test (CUT) . 

The figure of merit may be a fault detection ratio, 
which is defined as the proportion of a set of predefined 
5 faults that can actually be detected according to a set of 
criteria for fault discrimination. A fault detection 
ratio of imity is the ultimate objective of the 
optimisation process. The figure of . merit may be the 
Hamming distance between the digital output response for 
10 the fault free circuit and the output response for the 
faulty circuit. The figure of merit may be proportional to 
or a function of the Hamming distance. Additionally or 
alternatively, the figure of merit may be a composite of 
some or all of the above. 
^ The method may further involve determining a figure 

of merit for each one of a plurality of different faulty 
circuits, each of these figures of merit being indicative 
of potential differences between output responses of the 
fault free and modelled faulty circuits, and determining a 
20 composite figure of merit using each of these. In this 
case, the composite figure of merit represents the ability 
of an applied test signal to effectively detect the 
presence of faults in the CUT. The modelled faulty 
circuits may include circuits that have faults on a single 
25 component /parameter or on multiple components /parameters. 
This is advantageous. Of course,- it will be appreciated 




C that in practice to optimise this approach, it is 
necessaxy to select the most common or expected 
combination of faults for a given circuit. 

The process of varying the input digital signal may 
5 involve changing the length of one or more individual 
pulses in the applied digital input signal. The length of 
individual pulses may be varied by the same amount or by 
increasingly large or small amounts or by different 
amovints, which different amounts may be selected randomly 

10 or according to predefined criteria. The length (time- 
duration) of all of the pulses may be varied by the same 
amoTxnt in sequence one after the other, a figure of merit 
being determined each time one pulse length is changed. 
Once this is done sund in the event that a sequence having 

15 an improved figure of merit is not determined, the method 
may further involve changing the size of the amount by 
which the pulse lengths are varied and repeating the 
process of varying. 

Additionally or alternatively, the process of varying 

20 the input digital signal may involve applying a pre- 
determined function to the input sequence, such as a 
pattern shift function, which function in effect modifies 
all pulses in the input pattern at once. The step of 
applying a pre-determined function to the input sequence . 

25 may occur after an improved sequence is found by vairying 
the individual pulse lengths. 
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Additionally or alternatively, exhaustive evaluation 
of the figures of merit for all possible sequences of 
limited length (number of bits, each bit of certain time- 
duration) may be used to find good initial or starting 
sequences. In order to achieve this, the process of 
varying may involve varying the frequency of the input 
signal, the frequency being defined by the reciprocal of 
signal time-duration. The frequency may be incrementally 
varied by a pre-determined amount over the bandwidth of 
the CUT. For each frequency, for each length and for each 
possible sequence a figure of merit is determined. The 
signal with the highest figure of merit is selected and 
preferably used as the initial input signal. In this way, 
a coarse search for a starting sequence can be done. 
Random starting sequences may also be employed. 

Additionally or alternatively, the method in which 
the invention is embodied could be used to deterraine .the 
functional perfoimance of CUTs. To do this, rather than 
optimising the input signal based on known faults, the 
signal is optimised to take into accoiint variations in 
values of functional specifications. This would involve 
transforming the deviation in CUT specifications to a 
corresponding deviation in components values. In this 
way, not only the presence of a fault could be detected 
but also the deviation of one or many of the CUT 
specifications could be detected. 



According to another aspect of the invention, there 
is provided a digital test signal or of a copy thereof for 
testing analogue or mixed signal circuits that is a 
product of the method in which the first aspect of the 
5 invention is embodied. 

According to yet another aspect of the invention, 
there is provided a method for testing analogue and/or 
mixed-signal circuits using a digital signal, the method 
comprising applying to the CUT an optimised test signal as 
10 determined using the method in which the first aspect of 
the invention is embodied; comparing an output of the CUT 
with an expected output for a good circuit and determining 
a fault based on a result of the step of comparing. In the 
event that the outputs are substantially the same, within 
15 an accepted tolerance range, this indicates that the CUT 
is fault free. In the event that the outputs are 
different, these differences lying outside the accepted 
tolerance range, this indicates that the CUT is faulty. 

The outputs from the CUT may be analogue. The method 
20 may further involve digitising the output of the CUT, 
wherein the step of comparing may involve comparing the 
digitised outputs. The digitising of the output of the CUT 
may involve one or multiple qucintisation levels. 

The method may further involve storing an output for 
25 a fault free CUT with an acceptable tolerance range for an 
optimised input test signal and comparing the stored 
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output with the actual output of the CUT. The stored and 
actual outputs may be digitised. The step of comparing 
the stored and actual digital outputs may comprise 
calculating the Hamming distance between them. 
5 The method may further comprise storing outputs for 

known faults for the optimised digital test signal and 
comparing an output from a circuit under test with these, 
so that in the event that there is a miss-match, this 
indicates not only that there is a fault but possibly also 
10 the nature of that fault. 

In the event that the gain of the circuit is to be 
tested, the method may further involve modifying the input 
offset, voltage and/or the amplitude of the digital test 
signal. Preferably, this is done in conjunction with the 
15 output threshold level. 

According to* yet a further aspect of the present 
invention, there is provided a system for optimising a 
digital test signal for testing an analogue or mixed- 

20 signal circuit using a digital signal, the system 
coirprising means for determining a figure of merit that is 
indicative of differences between responses of a fault 
free cuid a faulty analogue or mixed signal circuit to an 
input digital signal; means for varying the input digital 

25 signal; means for deteinmining a figure of merit for the 
varied input signal, and means for selecting an optimum 
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test signal based on the determined figures of merit. 
Preferably, the means for selecting are operable to 
determine and select the input signal that has the maximum 
figure of merit. Preferably, the means for vaarying are 
5 operable to vary the input signal a plurality of times, so 
that a range of signals are tried, each of these being 
derived from the starting input. Preferably, the input 
signal is varied according to pre- determined criteria. 

The means for determining the figure of merit may be 
10 operable to use analogue outputs from the CUT. The means 
for determining the figure of merit may be operable to use 
digital outputs from the CUT. 

The system may further comprise means for determining 
a figure of merit for each one of a plurality of different 
15 faulty circuits and determining a composite figure of 
merit combining all of these. 

The means for varying the input signal may comprise 
means for changing the length of one or more individual 
pulses in the applied digital input signal. The means for 
20 changing the length of individual pulses may be operable 

to vary the pulse length by the same amount or by [ 
increasingly large or small amounts or by different 
amounts, which different amounts may be selected randomly 
or by predefined scheme. 
25 Additionally or alternatively, the means for varying 

may comprise means for varying the frequency of the input 
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diSfital signal, the frequency being defined by the 
reciprocal of signal time-duration. 

According to still another aspect of the invention, 
there is provided a system for testing analogue and/ or 
5 mixed-signal circuits using a digital signal, the system 
comprising means for applying to the circuit under test an 
optimised test signal as determined using the method in 
which the first aspect of the invention is embodied; means 
for comparing an output of the CUT with an expected output 
} for a good circuit and means for determining a fault based 
on an output from the means for comparing. In the event 
that the outputs are substantially the same, within an 
accepted tolerance range, this indicates that the CUT is 
fault free. In the event that the outputs are different, 
these differences lying outside the accepted tolerance 
range, this indicates that the CUT is faulty. 

The outputs from the CUT may be analogue. Means may 
be provided for digitising the outputs of the CUT and the 
means for comparing may be opereible to compare the 
digitised outputs. 

According to a still further aspect of the present 
invention, there is provided a computer program for use in 
a method of testing an analogue or mixed-signal circuit 
using a digital signal, the computer program being 
provided preferably on a data carrier or computer readable 
medium and having code or instructions for determining a 
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figure of merit 



that 



is 



indicative 



of potential 



differences between output responses of a fault free and a 
known faulty circuit in response to a digital input 
signal; varying the input digital signal according to pre- 
5 deteirmined criteria; calculating another figure of merit 
that is indicative of differences between the outputs of 
the fault free and the known faulty circuits in response 
to the varied digital input signal; and selecting an 
optimum test signal based on the determined figures of 
10 merit. Preferably, the selected input signal has a maximum 
figure of merit. Preferably, the step of varying is 
repeated a plurality of times, thereby to determine the 
best test signal. 



15 for modelling output responses for the fault free and 
faulty circuits* 

The various figures of merit may be determined using 
analogue outputs from each of the fault free and the 
faulty circuits. The figure of merit may be determined 

20 using digital outputs from the CUT. The figure of merit 
may be the fault detection ratio. The figure of jnerit may 
be the • Hamming distance between the digitised output 
response for the fault free circuit and the output 
response for the known faulty circuit. The figure of merit 

25 may be a composite of some or. all of the above. 



The computer program may have code or instmctions 
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The computer program may have code or instructions 
for determining a figure of merit for each one of a 
plurality of different faulty circuits, each of these 
figures of merit being indicative of differences between 
output responses of the fault free and faulty circuits, 
and determining a composite figure of merit using each of 
these . 

The code or instructions for varying the input signal 
may be adapted to change the length of one or more 
individual pulses in the applied digital input signal. 
The length of individual pulses may be varied by the same 
amount or by increasingly large or small amounts or by 
different amo\ints, which different amounts may be selected 
randomly or according to a predefined scheme. The length 
of all of the pulses may be varied by the same amount in 
sequence one after the other, a figure of merit being 
determined each time one pulse length is changed. 

Additionally or alternatively, the code or 
instructions for varying may be adapted to apply a pre- 
determined function to the input sequence, such as a 
pattern shift function, which function in effect modifies 
all pulses in the input pattern at once. The pre- 
deteannined function may be applied to the input sequence 
after an improved sequence is found by varying the pulse 
lengths . 
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Additionally or alternatively, exhaustive evaluation 
of the figures of merit for all possible sequences of 
limited length (number of bits) may be used to find good 
initial or starting sequences. The code or instructions 
5 for exhaustive evaluation may be operable to vary the 
frequency of the input signal, the frequency being defined 
by the reciprocal of signal time-duration. The frequency 
may be incrementally varied by a pre-determined amount 
over the bandwidth of the CUT. For each frequency^ for 

10 each length and for each possible sequence a figure of 
merit is determined • The sequences with the highest 
figure of merit are selected and preferably used the 
initial input signals. 

According to still another aspect of the invention, 

15 there is provided a computer program for use in a method 
of testing an analogue or mixed-signal circuit using a 
digital signal, the computer program being provided 
preferably on a data carrier or computer readable mediiim 
and having code or instructions for applying to a CUT a 

20 test signal as determined using the method in which the 
first aspect of the invention is embodied; comparing an 
output of the CUT with an expected output for a good 
circuit and determining whether there is a fault based * on 
an output from the means for comparing. 

25 The outputs from the CUT and the fault free circuits 

may be analogue. The computer program may be operable to 
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use digitised outputs of the CUT and fault free circuits 
when comparing the fault free and CUT outputs. 

The -method may further involve storing a figure of 
merit for a circuit having a known fault and comparing the 
5 figure of merit for the CUT with that for the known fault. 
In the event that there is a match, this indicates not 
only that there is a fault but the nature of that fault. 
This is advcucitageous * 

According to another aspect of the invention, there 
10 is provided a test system that includes means for 
generating an optimised digital test signal as determined 
using the method of the first aspect of the invention, 
means for applying the digital test signal to an analogue 
or mixed-signal CUT, means for comparing an output of the 
15 CUT with an expected output for a good circuit, which is 
also stored or generated locally, and means for 
determining a fault based on an output from the means for 
compar-ing . 

The outputs from the CUT may be analogue. Means may 
20 be provided for digitising the outputs of the CUT and the 
means for comparing may be operable to compare the 
digitised outputs . 

The above mentioned test system may be provided on 
the same chip as the CUT. The test system may be provided 
25 as a self-test facility. 
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C^^ According to yet another aspect of the present 

invention, there is provided a electronic device, such as 
a mobile telephone, that includes a test system that has 
means for generating an optimised digital test signal as 
5 determined using the method of the first aspect of the 
invention, means for applying the digital test signal to 
an analogue or mixed-signal CUT, means for comparing an 
output of the CUT with an esqpected output for a good 
circuit, which is also stored or generated locally,, and 
10 means for determining a fault based on an output from the 
means for comparing. 

BRIEF DESCRIPTION OP THE DRAWINGS 

Various aspects of the invention will now be 
15 described by way of example only and with reference to the 
accompanying drawings, of which: 

Figure 1 is a block diagram of a test system for 
testing analogue or mixed-signal circuits; 

Figure 2 shows various examples of analogue responses 
20 and their corresponding one-bit quantised responses, 
before and after the comparator in Figure 1; 

Figure 3 shows various analogue signals and their 
digital responses for a fault free CUT and a faulty 
version thereof; 

25 Figure 4 is a block diagram of an arrangement for 

determining a figure of merit for a faulty circuit; 
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Figure 5 shows the effect of applying a sigmoidal 
fiinction to an analogue signal in the arrangement of 
Figure 4; 

Figure 6 shows various analogue responses due to 
tolerances within a test circuit; 

Figure 7 is an example of the tolerance limits of 
Figure 6; 

Figure 8 shows the maximum, nominal and minimum 
envelops of the tolerance responses of Figure 6; 

Figure 9 is a block diagram of a system for measuring 
a composite figure of merit for a circuit that may have 
various potential faults; 

Figure 10 is a flow diagram of an algorithm, for 
optimising selection of an input signal; 

Pigrure 11 is an example of a binary sequencer- 
Figure 12 is a 3-D representation of a hill-climbing 
surface that is generated using simplified sequences of . 
only two runlengths (a high and a low pulses) ; 

Figure 13 is a circuit diagram of a low pass filter 
{exemplar circuit) ; 

Figures 14(a) to (c) show the frequency responses for 
a fault free version of the filter of Figure 13 , various 
different versions of the circuit of Figure 13 , but within 
tolerance ranges and different faulty versions of the 
circuit of Figure 13; 
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Figure 15 shows various waveforms for fault free and 
faulty versions of the circuit of Figure 13 (without 
tolerances) ; 

Figure 16 shows a table of simulation results for the 
5 filter of Figure 13, also without tolerances; 

Figure 17 shows an example of a test signal and its 
responses for gain measurement of a CUT, and 

Figxire 18 is a chart that sximmarises the overall 
features of the optimisation technique and test method. 

10 

DETAILED DESCRXPTXON OF THE INVZ^NTXON 

The aim of mixed-signal testing is to detect 
manufacturing defects . Integrated circuits can have two 
types of permanent faults, namely catastrophic or 
15 parametric faults. A catastrophic fault is one in which 
the coir^onent is destroyed, for example by virtue of a 
short circuit, an open circuit or a topological change. 
With parametric faults, the component continues to 
function, but outside the nominal tolerance band. 
20 Examples of faults that have to be detected include: short 
circuit, open circuit, positive deviation from fault free 
behaviour and negative deviation. By choosing a suitable 
binary test signal, these can be identified. 

In accordance with the present invention, two modes 
25 of operation have to be carried out in order to test 
mixed-signal circuits. Firstly, a test development mode 
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is conducted to determine the optimum test signal. When a 
suitable test signal is identified, a test applicatipn 
mode uses that optimised signal to test circuits. This is 
done by applying the signal to the CUT and monitoring its 
5 response , 

The test development mode includes three basic steps 
of determination of a potential fault list, identification 
of an efficient input test pattern, and storage of a 
threshold for fault detection. The efficient input test 
10 pattern is used to derive a reference output pattern for 
the fault- free CUT, Every CUT has unique input and output 
reference patterns. These circuit-dependent reference 
patterns are stored in a database. When the test 
development mode is completed, the test application mode 
15 is entered. At this stage, a similarity or comparison 
measurement between the actual response of a circuit and 
the stored reference pattern is performed. If they are 
sufficiently different, then the CUT is declared faulty. 
Otherwise, the circuit is deemed acceptable. 
20 Figure 1 shows a circuit for digital testing of 

analogue and/ or mixed-signal circuits. This has a digital 
signal generator for applying a digital test signal to the 
mixed- signal circuit that is to be tested. The test 
signal is a periodic discrete interval binary sequence of 
25 .N bits. By this it is meant that the input signal can 
change between the two possible levels only at discrete 
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intervals of time, which intervals are normally equally 
spaced. This is done in order to limit complexity and 
amount of information. This is not a fiindamental 
limitation, but is nevertheless a useful practical 
5 requirement. The input sequence must be kept as simple as 
possible and hence the corresponding discrete interval of 
time will be no shorter than required to characterise the 
circuit together with expected faults. The methodology 
for identifying an optimum input signal is described 
10 later . 

This input test sequence is fed through a buffer from 
a digital signal generator and into the CUT. Connected to 
the output of the CUT is a comparator for comparing the 
CUT output signal with an optimised threshold. The 

15 comparator is in turn connected to processor that has 
access to a memory in which are stored the reference 
outputs for a fault free version of the CUT, as well as 
reference outputs for circuits with known faults. 

Whilst not shown on Figure 1, it will be appreciated 

20 that the system must be synchronised to a master clock so 
that testing is performed with synchronised input/output 
binaiT^ sequences. In addition, the comparator output must 
be digitised faster than the clock speed of the input 
sequence for precise recording of the zero crossings. 

25 When a circuit is to be tested, the digital test 

signal is applied to it. The resulting output signal from 
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the CUT is analogue. This is passed to the comparator for 
processing. The comparator in effect reduces the analogue 
response of the CUT to threshold crossings recorded 
against time. The output of the comparator is either logic 
high or logic low depending upon the result of comparison 
between the CUT response and the comparator threshold and 
• so is "a binary sequence of Os and Is that is indicative of 
the. digital response of the circuit. Examples of analogue 
responses from the CUT and the corresponding one-bit 
quantised responses from the comparator are shown in 
Figure 2 . 

The binary signal output from the comparator is then 
passed to the processor for comparing it with the stored 
reference binary sequence for a substantially fault free 
CUT. More specifically, the two binary signals are 
compared and the Hamming distance between them is 
calculated. The Hamming distance between two binary 
sequences is the nimiber of digits in one of the two 
sequences that have to be changed to make it the same as 
the other. This task may be alteimatively accomplished 
using combinational logic circuitry. 

In. the event that the output from the test circuit 
and the stored sequence are the same, within a pre- 
determined limit, i.e. the Hamming distance is 
substantially zero, this indicates that the circuit is 
acceptable. In contrast, should the output and the stored 
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sequence be different, i.e. should the Haroming distance be 
non-zero, this indicates that the tested CUT is faulty. 
In this event, an alarm is raised and the circuit is 
designated as being faulty. Hence, by means of a one-bit 
5 quantisation, a straightforward, cost effective and fast 
means of detecting faults is provided. It should be noted 
that in practice, differences in some times lots due to 
component tolerances are non-diagnostic and are excluded 
from the evaluation. This will be discussed in more 

10 detail later. 

The key to successful testing of an analogue or 
mixed-signal circuit is the rapid detection of as many 
potential faults as possible. A good digital input 
sequence detects all or at least most of the considered 

15 faults for a particular circuit. Therefore, in order to 
optimise testing, it is necessary firstly to find the best 
binary sequence for inputting to the CUT to detect faults, 
by exploring the behaviours of all possible sequences that 
meet specified criteria. The strategy used to do this is 

20 to develop a test methodology using a computer-based 
simulation of the circuit-under- test. The principal reason 
for simulating the performance of circuits is to enable 
direct control over fault conditions, which control cannot 
be achieved with hardware. Other reasons are speed of 

25 execution and flexible facilities to automate the entire 
design process. Furthermore, diagnostic information is 
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available which could not practicably be accessed on real 
hardware. It is critical also that there should be 
absolute control over tolerances. Again, this cannot be 
achieved with real components. Feasibility of this 
approach recpiires availability of software to determine 
the output of any specified circuit to any specified input 
signal. Commercial software, generally based on 
methodology known as Spice, has been available for many 
years. This can be adapted to put the method in which the 
invention is embodied into practice. 

To identify an optimised test signal, a multi- 
dimensional hill climbing search algorithm is implemented. 
This algorithm uses a figure of merit as a measure of how 
good an input signal is at detecting faults. In order to 
limit complexity and amount of information^ the input 
signals used are discrete interval binary secpaences, i.e. 
they change between the two possible levels only at 
discrete intervals of time, which intervals are normally 
equally spaced. This is not a fundamental limitation, but 
is nevertheless a useful practical requirement. The input 
sequence must be kept as simple as possible and hence the 
corresponding discrete interval of time will be no shorter 
than required to characterise the circuit together with 
expected faults. 

In the present case, the figure of merit is a measure 
of the effectiveness of a binary input sequence in 
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detecting faults. The input sequence with the maximum 
figure of merit is considered the best. Hence, the main 
objective of the optimisation procedures is to find the 
maximtim value of the figure- of -merit and the coordinates 
5 of the binary sequence for which this value is achieved. 

In practice, the figure of merit could be extracted 
from either the analogue response that is output directly 
from the CUT or from a one-bit digitised response that is 
provided by passing the analogue signal through a 
10 comparator, thereby providing analogue and digital figures 
of merit AFM and DFM respectively- These are related as 
can be shown from the following analysis. 

Assume that x^it) and J(\{t) are the analogue responses 
of a fault- free CUT and a faulty circuit, and y{t) is the 
15 negative part of their product. y{t) can be defined as 
follows: y(f) = JCo (0*^1 (0 for ;Co(0*J«^i(0<0, and y{t) = 0 elsewhere. 
Since a negative product indicates a point in y{t) at which 
the fault-free response^ x^it) and the faulty response x^{t) 
have different polarities, then y{^ is indicative of the 
20 number of time slots at which XQ{t) and x^{t) differ in 
polarity. Figure 3 shows examples of these signals. The 
polarity differences are related to the digital Hamming 
distance between the one-bit digitised responses of the 
good and faulty responses x^it) and x^{t) respectively. 



-26- 




Furthermore^ they contain intermediate information that 
can guide the search for an optimum input signal . 

The continuous AFM is a function of y{t) and can be 
expressed as follows: 



AFM = ly{t)dt 



where T is the period of the steady state response. In 
the computer simulation, the continuous signals are 
sampled at discrete time intervals. The sampled AFM can 
then de described as: 



10 AFM=X)y(0 



where: y(0 = J«^o(0*^i(0 for Xo(0*JCi(0 <0, i:l to niimber of 
samples n and ^(0=0 elsewhere 

The DFM is the number of samples at which the product 
^o(0*JCi(0 is negative. The AFM is the sum of the samples 
.15 at which the product JCqO") *JC, (i) is negative and can be 
rewritten as : 

n 

^'■^ = 

where NA is the sum of the negative values of the product 
divided by the number of these negative values, which 
20 is the DFM. This shows that there is a direct relationship 
between the AFM and the DFM, Furthermore, it shows that 
the AFM inherently includes the DFM. 
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As will be appreciated from the above analysis, very 
small and very large values of y{t) have the same value of 
DFM making it vulnerable to noisy signals. In contrast, 
the AEM is relatively immune to noisy signals. In 
5 addition, in practice it is found that analogue 
information in effect guides the hill-climbing search for 
a test signal naturally towards an optimum solution. This 
is because the APM takes account of sections where the 
signals approach the threshold. As shown in Figure 2, the 
10 dip in the first analogue response is close to the 
comparator level. A small incremental change of the input 
binary sequence may pull this dip down and change the 
digital response, as shown in the second analogue response 
of Figure 2, which may increase the Hamming distance. 
15 This directive information is not available in the digital 
responses. Consequently, the figure-of -merit should be 
extracted from the analogue responses and should be 
directly related to the digital Hamming distance, which is 
used in the test application mode to identify faults. 
Hence, in the test development stage, the AFM is used as a 
measure of the effectiveness of a given binary sequence in 
detecting faults. However, after finding the optimum 
input sequence using the APM in the test development mode, 
typically the DFM is calculated and used during the test 
application mode to identify faults. 
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Figure 4 shows an arrajigement for detecting 
differences between a single faulty response and a good 
response using the AFM. This is a diagrammatic 

representation of methodology that is implemented in 
5 software* Hence, whilst it shows blocks of components 
such as multipliers and comparators, it will be 
appreciated that physical components are not used, but 
instead are modelled using computer-based software. 

The arrangement of Figure 4 includes an input for 

10 receiving a signal from a good CUT, an input for receiving 
a signal from a faulty CUT and a comparator. The 
comparator threshold level is a DC voltage, based on which 
a comparison is made. During calculation of the figure of 
merit in the optimisation procedure of the test 

15 development mode, multiple values for the comparator 
threshold are used and the one which yields highest figure 
of merit is selected. The comparator threshold level is 
subtracted from each of the input signals at respective 
summers. If x^it) is the nominal analogue response for the 

20 good CUT and Comp is the comparator threshold level, the 
signal of interest is the difference between them. This 
difference (Xo(/) - Comp) indicates whether x^(t) is greater 

than Comp or not. 

When the difference (this difference is represented 
25 by the negative values of the product of two traces) 
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faulty analogue response is sufficiently large to provide 
adeqpiate discrimination, a procedure is carried out to 
prevent the figure of merit from increasing further at 
5 localised difference. This can be achieved by applying a 
function to the signal for preventing unnecessarily large 
differences in the output dominating the figure of merit 
during optimisation. The main requirement for this 
function are that the output should saturate at two 
10 different predetermined values (often -1 and +1) for 
extreme negative and positive values of input. In between 
these saturation regions, the function should increase 
monotonically, and hence be single-valued. An example of a 
suitable function is the sigmoidal function, which employs 
15 a non- linear squashing function based on the sigmoid or 
logistic equation- Low inputs are mapped to values near 
the minimum activation, and high inputs are mapped to 
values close to the maximum activation. Intermediate 
inputs are mapped non-linearly between the activation 
20 limits. Note that the sigmoidal function is equivalent to 
the standard sigmoid function when activations range from 
0 to 1 and the standard hyperbolic tangent function when 
activations range from -1 to +1. 

Applying a sigmoidal function to the signal of Figure 
25 4 prevents domination of large differences in the output. 
This procedure avoids the optimisation increasing further 
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amplitude between the two analogue signals once that 
difference is sufficiently large to provide adequate 
discrimination. Otherwise the optimisation process might 
5 continue to increase these localised differences' even 
further at the expense of establishing an adequate 
difference at other times within the same signals. 

The hyperbolic tangent fiinction (tanh) is used as an 
example of the sigmoidal function, although other 
10 functions might be equally applicable. The nominal signal 
xCq(/) is then defined by: 



where Xg is the input saturation level. For example, the 
level at which the actual coit^arator changes its output. 

15 This will prevent very small outputs dominating the figure 
of merit calculation. Figure 5 shows an example of a 
nominal signal before and after the hyperbolic tangent 
function is applied. Of course, whilst these steps are 
described with reference to Xo(t), which is the analogue 

20 response of the fault free CUT, they are also carried out 
for Xi(t) , which is the analogue response for the modelled 
faulty circuit. Hence, the nominal signal xci(t)for the 
faulty CUT is also defined by: 



xCo(t) = tanhC [xo (t) - Comp}/x^ } 



xci(t)=tanh{ [xit) -comp] /x^} 
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After being acted on by the sigmoidal function, the 
signals are then multiplied together. The product of the 
two signals is then acted on by a tolerance confidence 
fixnction to take into account tolerances in the CUTS. In 
5 the present case, the tolerance confidence f\inction is 
multiplied with the in-coming signal. 

Accounting for tolerances in analogue circuits is 
important, because the perfoinnance of each component can 
vary with certain tolerance band. This can result in a 
10 family of valid responses, as shown in Figure 6. Any 
faulty response should be distinguished from all of these 
family members. 

In the actual test application mode, the analogue 
response is transformed to a digital response, which is 
15 equivalent to the crossings of the analogue response with 
the time axis, by comparing the analogue response with the 
comparator threshold level. The effect of tolerances has 
an impact on these crossings. Consequently, the spread of 
time-axis crossings due to tolerances is acceptable. 
20 Therefore, this spread in time-axis crossings is non- 
diagnostic and should be excluded from the evaluation of 
the figure of merit. The region of the spread of time-axis 
crossings due to tolerances at certain comparator level is 
defined by tolerance limits fvmction Tol{t), where Tol(t) 
25 is zero in the tolerance region and unity anywhere else. 
Figure 7 illustrates an example of Tol{t) . 
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The family of circuits due to tolerances is large and 
as will be appreciated increases as the nxoitiber of 
components increase • Several methods are used to reduce 
the number of these circuits and to derive the tolerance 
limits function Tol(t) to be used, in the final Figure-of- 
Merit. For example, the worst-case tolerances can be used 
to identify the upper/lower tolerance combinations, which 
correspond to max/min envelopes of the tolerance 
responses, as depicted in Figure 8. Alternatively, 
sensitivity analysis can be used to identify the extreme 
combinations of worst-case tolerances . This analysis 
identifies the polarity of a component deviation such that 
the equivalent time-axis crossings are increased or 
decreased. 

Once the signal of Figure 4 is processed to take into 
account tolerances, it is then half wave rectified to 
retain only the negative values, which values are 
indicative of the actual Hamming distance. Afterwards, the 
negative values are summed and normalised by the nximber of 
the input signal samples. These negative values of the 
product of a good and a faulty response represent those 
time durations where a polarity difference exists between 
them. This is because if one of the two responses is 
positive and the other is negative then their product will 
be negative and if they are both positive or both negative 
then their product will be positive. Once time durations 
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due to tolerances are removed from the product, the 
resulting negative values are diagnostic and provide an 
indication of how much the responses of the good and 
faulty circuits differ. 
5 Figure 4 provides a mechanism for determining the 

differences between a fault free and a single faulty 
circuit, thereby to establish a figure of merit* In 
practice, however, it is likely that CUTs have a range of 
potential faults and each CUT may include more than one of 
10 these* It is 'therefore important to have a figure of 
merit that is sensitive and robust enough to detect and 
identify any of that range of different faults in a given 
CUT. 

Figure 9 shows an arrangement for determining a 
15 figure of merit for an input signal to detect faults in 
the CUT. As for Figure 4, this is a diagrammatic 
representation of methodology that is implemented in 
software. Hence, whilst blocks of components such as 
multipliers and comparators are shown, it will be 
20 appreciated that physical components are not used, but 
instead are modelled using computer-based software. 

In the methodology .of Figure 9, the input signal is 
passed through the good CUT to provide an ideal response 
and likewise through each of a plurality of modelled 
25 faulty circuits, each of the modelled faulty circuits 
having a known but different fault or' combination of 
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faults. The selection of the faults to test for depends 
on the nature of the CUT and the coiaponents used in it. 
Each of the resultant signals for the faulty CUTs is then 
processed as described with reference to Figure 4. The 
5 output of the differencing is then acted on by a sigmoidal 
function, to prevent any given fault from dominating the 
overall figure of merit, to produce a figure of merit for 
each faulty CUT* As before, any reasonable input-output 
fxznction can be employed for this, the requirements being 
10 that the output should saturate at two different 
predetermined values for extreme values of input. In 
between these saturation regions, the function should 
increase monotonically, and hence be single -valued. The 
hyperbolic tangent has worked well but other functions 
15 might be equally suitable. These figures of merit are then 
summed and divided by the number of modelled faulty CUTs, 
thereby to provide a composite figure of merit. 

For the arrangement of Figure 9, if x^(t) is the i*^*^ 
faulty response, where, 1 =1 to F faults, then the 
20 difference Di between the i*^^ faulty response and the valid 
responses is defined by: 
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where, d(j)--xc^(j)*xCfU)^TolU) for xc^U)''xc,{j)^TolU) <0, and 



d{j)-0 elsewhere and n is the number of samples of the 
input test-signal. 

The ability to detect individual faults is combined 
5 into a single composite figrure of merit. The individual 
figures of merit for each fault are most easily combined 
through summation, possibly weighted according to the 
iinportance of each fault and/ or the expected probability 
of occurrence. If the figure of merit for each fault is 
10 acted on by the sigmoidal function before such 
combination, then the optimisation procedure will tend not 
to increase that individual figure of merit once it 
achieves the specified saturation level . Optimisation thus 
concentrates on achieving adequate performance over all 
15 faults rather than improving even further those faults, 
which are already adequately recognised. 

In practice, the final figure of merit may be defined 

by: 

20 FoM=' (1/F) *sum ( [tanh (D±/Ds) ])\ whore 1=1 : number of fa.ul ts F 
The hyperbolic tangent function (tanh) is used as an 
example of the sigmoidal function. The value of Dg is 
different from Xs* Ds is the value of the difference 
saturation level, and is chosen to ensure that more than 

25 adequate measure of a fault does not contribute much more 
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to the composite figure of merit (for example, after 2 0% 
measure of a fault difference, there will not be much more 
contribution to the composite figure of merit) . It should 
be noted that the minus sign ensures a positive value of 
FoM, since individual differences are negative valued. 

The figure- of -merit described above is immune to very- 
large single fault differences. This is achieved by using 
the first sigmoidal function. It is also designed to* 
prevent fault domination by using the second sigmoidal 
function with Dg. Hence, a well-detected fault does not 
contribute much more to the final f igure-of-merit than an 
adequately detected fault. 

The f igure-of-merit described above Ccin measure how 
well a digital input sequence can detect faults and its 
fault coverage, i.e. how many faults it can detect. Since 
each fault contribution is acted on by the sigmoidal 
function, it has a maximum contribution to the composite 
figxire of merit of unity (before normalisation by the 
number of faults). Thus, the proximity of each fault 
contribution to unity indicates how well it has been 
detected. The proximity of the noarraalised (by the total 
number of faults) composite figure of merit to unity 
indicates how well all faults are detected and thus how 
many are not. 

The figure of merit is normalised to a number ranges 
from zero to one. This allows the hill-climbing 
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optimisation algorithm to develop by knowing in advance 
the maximum allowed value ^ which is unity. The figure of 
merit is also directly related to the Hamming distance, 
which is used in actual test circumstances. 
5 The figures of merit, obtained in the manner 

described above, are used in the search algorithm in order 
to determine the optimum input seqiience. The optimisation 
search can be considered a hill-climbing optimisation 
problem. A • simplified flow chart of the algorithm is 
10 shown in Figure 10. Before running the algorithm, it is 
necessaary firstly to have a description of the CUT and a 
list of faulty circuits. To identify characteristic 
performances for a given input sequence, the fault free 
and modelled faulty CUTs are tested either using the 
15 circuit of Figure 9 or modelled. The modelled behaviour 
can be provided, for example, using the well-known MALAB 
programming tool^ which can generate input sequences^ 
simulate CUTs and simulate output signals. As before, the 
modelled faulty circuits may include circuits that have 
faults on a single component /parameter or on multiple 
components /parameters , these faults being selected on the 
basis that they are the most likely to occur for a given 
circuit. 

To optimise the input signal, the algorithm starts by 
identifying a good initial binary sequence that is either 
arbitrarily chosen or based on prior knowledge of the 
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circuit. This is applied to the arrangement of Figure 9 
to determine the composite figure of merit for that input. 
One or more predeterxained techniques are then applied to 
modify the initial sequence by, for example, vsixyLng the 
5 pulse width of at least one pulse in the sequence. 
Incremental changes are made in the timing of the 
transition points from high to low to give a number of 
potentially improved sequences. Each of these is then 
applied to the fault free and faulty CUTs. Once this is 
10 done, all possible values of the comparator threshold are 
scanned to select the comparator threshold of highest 
figure of merit'. The best comparator threshold is used to 
calculate the composite ficfure of merit for each input 
sequence, thereby to summarise its ability to detect the 
15 full range of faults. The input with the highest figure 
of merit is selected and retained. If this is' the initial 
sequence then the algorithm terminates. If the selected 
sec[uence is not the initial sequence, then the algorithm 
starts again using the sequence with the highest figure of 
20 merit as the initial sequence. In this case, however, the 
size of the incremental change is varied. This process 
continues, with the step size being varied, until the 
selected sequence is the initial sequence, at which stage 
the algorithm teinninates. 
25 Given a CUT description, with component /parameter 

values, the frequency bandwidth of the CUT and a set of 
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potential faults, which covers the most probable defects 
that may occur during the manufacturing process, the hill 
climbing algorithm in effect sets out to search for and 
find an optimised set of binary sequences. Each sequence 
5 targets a group of faults, with associated comparator 
threshold level (s), to maximize the figure-of -merit and 
consequently the fault detection ratio. Variables include 
the integer run lengths of the binary sequences. This 
multidimensional problem may have more than one peak and 
10 the shape of its surface is completely unpredictable. 

A more detailed description of the optimisation or 
search algorithm will now be given. 

As will be appreciated, the response of a given CUT 
with faults differs from that of the fault-free circuit at 
15 certain frequencies. Consequently, the applied test signal 
should probably have more energy within these frequencies 
. and be located at the part of the spectrum that is most 
sensitive to faults. Hence, to select good starting 
sequences, the search algorithm is operable to implement 
20 an exhaustive search examining all relevant binary 
sequences of limited lengths (i.e. ninnber of bits) and 
different fundamental frequencies and selecting the most 
appropriate of these. Any binary sequence has two main 
properties, the length (i.e. nximber of bits) and the time 
25 duration, which is the reciprocal of the fundamental 
frequency of the sequence. If the nxmiber of bits is fixed 
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and the time-duration of the bit is changed, then the 
whole sequence will be changed. For exainple, consider a 
binary sequence of 4 bits, one possible combinations of 
these bit is 1001. Then, the sequence 1001 with bit 
5 duration of 1 second is not the same as 1001 with bit 
diiration of 2 seconds. The possible sequences of 4 bits 
are (e.g. 0000, 0001, 0011, 0010, 0111, 1001, and etc) . 
If the bit duration is changed, each of these will result 
in another sequence. The total sequence duration (number 
10 of bits X bit duration, e.g. 4x1 second = 4 seconds) is 
the reciprocal of the sequence fundamental frequency. If 
the length is fixed, then the frequency . can have many 
values, and consequently many values of the bit durations. 
If the length and the frequency are fixed, then all 
15 possible combinations of the sequence bits (e.g. 0000, 
0001, 0011, 0010, 0111, 1001, and etc) can be considered. 

The best length, or the best frequency or the best 
combination of bits within a sequence is not known in 
advance. Therefore, the punrpose of the exhaustive search 
20 is to find a sequence or more sequences of good 
performances. As the nimiber of bits increases, the number 
of their possible combinations increases, e.g. for 32 bits 
we may have 2 '^32 which is about one billion sequences. So, 
the lengths / i.e. the number of bits, of the sequences 
25 considered is kept to a small niaraber, so that all of their 
combinations can be evaluated. Multiple lengths with 
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multiple fundamental frequencies are considered for the 
exhaustive search • For each fregpiency, for each length and 
for each possible sequence a figure of merit is 
deteannined . 

5 More particularly, the exhaustive search involves 

selecting a number of frequencies covering the bandwidth 
of the CUT, which is in practice known, and generating a 
plurality of unlabelled binary sequences of small lengths, 
e.g. up to 16 bits. A first one of the selected 
10 frequencies is then selected and for every one of the 
plurality of binary sequences the bit duration is set to 
(1/ length) x(l/ frequency) . Once this is done, a figure of 
merit is calculated for every unlabelled sequence of a 
given length. The sequence having a maxim\am figure of 
15 merit for that particular length and frequency is then 
determined. This is repeated for every length. Once this 
is done, the sequences having a max:imum figure of merit 
for eveiry length and one frequency are determined- The 
whole process is then repeated for the next frequency 
20 until all pre~selected frequencies are tested. Then, the 
sequences that have the maximum figures of merit for every 
length and all frequencies are determined. The number of 
obtained sequences is the niomber of lengths considered. 
In this way, a group of initial sequences can be 
25 determined . 
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It should be noted that to remove redundancy^ 
sequences that are equivalent under rotation and/or 
inversion are not considered in the exhaustive evaluation. 
Since both input and output sequences are periodic, the 
5 choice of the starting position within the input sequence 
is arbitrary. This "means that the rotation of a given 
binary sequence by any position in both directions will 
not change the effect of that binary sequence (1101 is the 
same as 1011) . Furthermore, at least for linear circuits, 

10 inversion of a binary sequence provides no additional 
information {1000 is the same as 0111) . Therefore, it is 
necessary to consider only those sequences that are non- 
equivalent under rotation and/ or inversion. 

The set of non- equivalent under rotation and/ or 

15 Inversion binary sequences are known in combinatorial 
mathematics as unlabelled binary necklaces. These are 
described in the article ^^Classes of Periodic Sequences" 
by Fine, Illinois J. of Math, Vol- 2, pp. 285-302, 1958. 
For exait^le, the set of unlabelled necklaces of four bits 

20 is {0000, 0001, 0011, and 0101}. The number of unlabelled 
necklaces of number of 16 bits equals 2068. During initial 
investigations, the sequence length was sufficiently 
limited to 16 such that it would be possible to generate 
and then stimulate the CUT with all relevant sequences, 

25 which meet the predetermined constraints. 

The exhaustive search can be summarised as follows: 
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-select nxunber of frequencies covering the bandwidth of 
the CUT 

-generate unlabelled binary sequences of small lengths 
5 (e.g. up to 16 bits) 
-for every frequency 
for eveiY length 

set bit duration to (1/ length) x(l/ frequency) 
jfor every unlabelled sequence of a given length 
10 calculate the Figure-of-Merit 

end 

find the sequence of maximum Figure-of-Merit 
(for particular length and frequency) 
end 

15 find the sequences of maximum Figure-of-Merit 

(for every length and one frequency) 
end 

-find the sequences of maximum Figure-of-Merit (for every 

length and all frequencies) 

20 // The number of obtained sequences is the number of 
lengths considered // 

Once the exhaustive search is completed and good 
starting sequences are identified, the algorithm is 
25 operable to carry out a local search. This is done using a 
direct-search optimisation strategy, such as the algorithm 
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of Hooke and Jeeves [Hooke, R. and Jeeves, T, A.: ^^Direct 
Search Solution of Nximerical and Statistical Problems", 
Journal of the Association for Computing Machinery, Vol* 
8, pp. 212-229, 19611- However, any other optimisation 
strategy could be applied. 

The local search can be considered an n-dimensional 
hill-climbing problem, in which each dimension corresponds 
to one rtinlength Ri of the binary sequences. Two distinct 
adjustments to the input secjuence can be made, these being 
exploratory moves and pattern moves. Any binary sequence 
is a series of n rxins R± with alternating polarities. Each 
run is the number of consecutive bits with same polarity. 
The transitions of polarity occur at time 

n 

Ti, where 7; =Xi^; 



15 Assxaming the amplitude of the input binary sequence is 
±A, (although a non-symmetrical binary signal may be used) , 
then this sequence can be described by the set of runs {Ri. 
Ra .» Rn/ where Ri is an integer) . Figure 11 shows a binary 
sequence in which various runlengths Ri, R2/ and Rn are 

20 shown. By varying the length of the runlengths for input 
sequences and calculating and optimising the figxire of 
merit for each of these sequences, a hill-climbing search 
is c onduc ted . 

The local search algorithm starts with the initial 
25 binary sequence selected by the exhaustive search, for 
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example = Ri R2...Rn, where n is the number of runlengths. 



Each runlength is adjusted in turn by a fixed step +AR. If 
increasing the first run length by +AR results in an 
increased figure of merit, the change is retained. If not, 
5 the first rxmlength is changed by - AR. In the event that 
this change results in an increased figure of merit, then 
the change is retained. In contrast, if changing the first 
run length by -AR fails to improve the figure of merit, 
then R^ is not changed. This is repeated for all 
10 runlengths of the sequence. After adjusting all runlengths 
Ri...to^Rn, if no new sequence is established, the step size 
is reduced and the exploratory moves are repeated. If a 
new sequence R^"^^ has been established, this " is used as the 
new base point for a pattern move, 
15 To implement a pattern move, the local search 

algorithm is operable to apply a shift function to the 
sequence that is output from the initial exploratory 
steps. A shift function moves the whole pattern in the 
search space, not a shift of the test sequence in time 
20 domain. For example, if Rl = [5 5 10 10] and R2 = [2 2 2 
2], then a pattern shift of Rl by R2 may be as: R3 = 2R1 - 
R2 = [8 8 18 18] . More generally, the pattern move may be 
for example R®"'^=2R^*^-R^, where R^""^ is the result of the 
pattern move. Once the pattern is shifted to R^""^, the 
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exploratory steps described previously are repeated 
starting with R^*^, that is the nmlengths are each varied 
in turn in order to identify the sequence with the maximura 
figure of merit. If the exploratory steps fail to improve 
5 the figure of merit of R^"*"^. R^"^ is used as a starting 
sequence and the e35>loratory steps are conducted. If the 
exploratory steps succeed to improve the figure of merit 
of R^*^ a new sequence R^*^ will be established and R^""^ & 
R^*^ are considered for further pattern shift is applied, 

10 The algorithm repeats this process until the step size 
equals a pre-determined minimum allowed value. 
Alternatively, the local search could be continued until 
no further improvement occurs. 

It should be noted that in the local search, if the 

15 step size is small, the algorithm is forced to search the 
nearby region, and may be stuck at a bad locale. If the 
step size is large, the algorithm may overlook a promising 
optimum. Therefore, using a variety of step sizes is 
recommended. The step sizes could be pre- determined or 

20 determined dynamically as the search progresses. Using 
several different step sizes when changing the signal 
incrementally could improve the probability of 
convergence, rather than changing the signal by the same 
amount each time. To improve the result of the local 
25 search, the obtained solution in one iteration is 
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considered as a starting sequence for a new iteration of 
the local search. This process . is repeated until no more 
improvement occurs, at the start of each iteration,, the 
step size of the change is resumed to its initial value. 
The local search can be summarised as follows: 



Set s=0, an index for sequences 

= Ri R2...Rn, sequence of n runlengths (pulses) 
^lle (better figure of merit) repeat 
10 WhxlB (better figure of merit), repeat steps (1) : (5) 
(1) //Exploratory moves// 

• i=l 

• (a) Adjust runlength R^i by a fixed step +AR to give 

15 • If (better figure of merit) , 

retain this change i*e R^""^ R^-t^^t 
and go to (b) 

• Else, change R®i by -AR to give new R^^^^^^t 
o If (better figure of merit), 

20 retain this change i.e R^"'^ = Rs_test 

and go to (b) 

o Else, keep R® xinchanged i.e. R^*^ = R^ and go to 
(b) 

♦ (b) 1=1+1 
25 • If i=n, go to (2) 
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• If i^n, go to (a) 

(2) If a new veqtor has been established 

i^e. use this new vector as the new base point for the 
5 pattern move and go to (4) 

(3) else (If a new vector has not been established) 

Vary the step size AR (unless it is already the 
minimum value ^ in this case exit inner while loop with 
best result) , for example by reducing it, and repeat 
10 the exploratory moves i.e go to (1) 

(4) Pattern move: 

Move the pattern R®"^ by the result of the exploratory 
moves R^ using a predefined function to give R^*^, for 
example, R^*^=2R^ -R^"^ 
15 (5) make exploratory moves i.e. go to (1) with the new 
sec[uence obtained 
end the inner while loop 

end the outer whilB loop (terminate the algorithm) 

Once the local search is completed, a local maximum 
in the figure of merit surface is identified. To optimise 
the search further, the algorithm is adapted to do a fine 
or neighbourhood search around this local maximum. The 
neighbourhood search involves applying positive and 
negative changes of unity step size in all indices of the 
input sequence and evaluating all possible combinations of 
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changes. More specifically, the neighbourhood search 
starts by using the input sequence that corresponds* to the 
local maximum identified by the local search- Fixed 
changes are then applied in all dimensions of the starting 
5 sequence simultaneously. This could for example involve 
changing every runlength in the sequence simultaneously by 
1 to provide a first modified sequence and then changing 
every runlength in the sequence simultaneously by -1 to 
provide a second modified sequence and so on until all 
10 possible combinations of +1, -1 and zero are made. Once 
this is done, the figure of merit for all modified 
sequences .is determined, and the sequence having the 
maximum figure of merit is retained. This process is 
repeated until no further improvement occurs, thereby 
15 guaranteeing that the obtained solution is the top of the 
local hill.' 

The neighbourhood search can be summarised as 
follows : 



while improving 

-apply all possible combinations of (0, +1 and -1) 
changes in all dimensions of 
the starting sequence simultaneously 
-calculate Figure-of-Merit for all modified sequences 
-keep the sequence of max Pigure-of-Merit 

end 



20 



25 
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Once the neigMDOurhood search is completed, the local 
search process is then repeated for the next of the range 
of starting sequences, as is the neighbourhood search, so 
5 that the highest of the figures of merit is obtained for a 
variety of different input sequences, ' As will be 
appreciated, the shape of the hill surface is completely 
unpredictable. When the final sequence is analysed, the 
maximxim composite figure of merit for all of the tested 

10 sequences is determined and the sequence that this 
corresponds to is identified as being the optimised 
signals In some cases, once the signal is optimised, the 
entire process is repeated, but with well-detected faults 
removed from the tested fault list. This is done on the 

15 basis that well detected faults can be readily detected 
and so the optimisation should focus on. those faults that 
are more difficult to identify, A second input sequence 
may be optimised exclusively for these difficult to 
identify faults. 

20 The main features of the test method and the 

optimisation algorithm described herein are summarised in 
Figure 18. The algorithm provides a robust and effective 
method for identifying an optimal digital test signals for 
an analogue or mixed signal circuit. It uses a coarsely 

25 quantised exhaustive search to find good starting 
sequences on the figure-of -merit hill. Once this is done, 
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a local search is conducted during which the runlengths of 
the input sequences are varied using several different 
initial step sizes, thereby to improve the probability of 
convergence. This is repeated until no further 

5 improvement occurs. A neighbourhood search is then done 
on the output of the local search by applying zero and .± 
change of unity step size in all indices of the input 
sequence and evaluating all possible combination of 
changes. This is done to guarantee that the top of a local 
10 hill can be id^entified. Well-detected faults are then 
identified and dropped and the whole process is repeated 
for the remaining faults. This is because it is unlikely 
to have one sequence that detects all faults. 

An enhancement to the methodology presented herein 
15 provides a solution to the tricky problem of measuring the 
gain of a CUT. However, it does not require optimisation. 
For dc CUT, in .which the frequency of the input test" 
signal has no effect on the behaviour of the CUT, the 

input signal offset and amplitude can be found by 

20 calculation, or iterative binary chop similar to 
successive approximation analogue- to-digital conversion. 
For ac coupled circuits, in which the behaviour of the CUT 
is completely dependent on frequency, the mark space ratio 
of the input digital signal can be adjusted to set the dc 
25 offset and the gain is adjusted as before. The input 
offset and amplitude are selected such that for a low 
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gain, the whole output signal is below the threshold. For 
gain too high, the whole output is above the threshold and 
only for gain within the correct range is the threshold 
crossed by the output as per the example in Figure 17- 
5 In order to test the method in which the invention is 

embodied, a second-order Sallen-Key active low pass filter 
(LPF) having a cut-off frequency of 2KHz (Kilo Hertz) was 
selected. An example of this is shown in Figure 13. The 
gain bandwidth product of the operational amplifier was 
10 assumed to be lOMHz (Mega Hertz) . Various faults 

including parametric deviation, open, and short-circuits 
were considered for simulation. The values of faults were 
chosen to satisfy the stability condition of the LPF. The 
MATLAB programming tool was used for input sequence 
15 generation, circuit simulation and output* processing. 
Figure 14 shows the frequency response of the three cases: 
fault-free, worst case tolerances and 22 faulty circuits. 
It is clear from this that the region at which most of the 
faults have the greatest difference from that of the 
20 fault-free response is around the cut-off frequency. Thus, 
the optimum stimulus is likely to have most of its power 
concentrated at those frequencies around cut-off. 

The binary sequence for stimulating the CUT was 
identified through the optimisation algorithm. For the 
25 sake of simplicity, the components tolerances are not 
included in this demonstrative results. However, they can 
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be easily incorporated in the calculation of the composite 
figure of merit. Setting the comparator of the test system 
at zero threshold, it was found that the binary sequence 
of the maximum value of the composite figure of merit has 



5 the following characteristics: 

• Number of bits = 53. 

• Bit duration or clock interval = 10 ySec, 

• Runlength of [+34 -11 +5 -3], where the sign is the 
polarity and the associated number is the runlength 

10 (the number of consecutive bits of same polarity) . 

The oversampling ratio was chosen to be unity. The 
optimised input sequence was repeated iintil the output 
voltage of the CUT settled. The settling time should be 
larger than the slowest settling time of the faulty 
15 circuits. For this particular circuit and set of faults, 
the settling time was less than 10ms (milli second) . 

The optimised input binary sequence stimulated all 
the CUT configurations* The output analogue, responses were 

fefeen — ©are--bife — quanti s ed — hy- — — ©ufepurt — eempaa^a-feo^" — wi-th— 

20 reference at zero. The resulting faulty binary sequence 
was then compared against the secfuence of the fault-free 
CUT, Figure 15 shows the simulation results for one fault 
(Rl+30%) as time domain responses. Figure 16 shows a table 
of simulation results for all 22 considered faults^ where 
25 the Hamming distance for each fault is shown graphically 
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and niamerically. Figure 16 shows that the timing of the 
output binary sequence is affected by the presence of a 
fault in the CUT. In Figure 16, the timing compcirison is 
made against that of an ideal fault-free CUT (all 
5 components are in their nominal values) . However, in 
practice this is not the case. Differences in some 
timeslots due to components tolerances are non-diagnostic 
and should be excluded from the evaluation. From Figure 
16, it can be seen that most of the faults • could be 
10 detected. 

According to the invention, there is provided a 
method for optimising a digital test signal for testing 
analogue or mixed-signal circuits and a method for using 
the optimised signal to test analogue emd/or mixed- signal 

15 circuits. Numerous advantages are provided by the 
invention. For example, it provides robust testing with 
wide fault coverage, including parametric failures. 
Because of the efficiency of the testing, the method also 
allows rapid device throughput. " The method is also suited 

20 to integrated circuit testing where routing analogue test 
signals is problematic. In addition, the method can be 
implemented using minimal on-chip overhead and cheaper, 
digital, external test equipment. Furthermore, minimal 
time is needed to design the test procedure. The skill 

25 level required by the test procedure designer is reduced 
and the process could be fully automated. There is also 
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scope to include test and verification circuitry on-chip 



giving complete built in test capability. Additionally, 
there is a reduced demand for expensive test equipment. 
Yet another advantage is the reduction of the hardware 
5 needed for stimuliis generation and response processing in " 
the test application mode to a single comparator and some 
comparison logic. This greatly simplifies testing and 
increases manufacturing throughput. 



10 the disclosed arrangements are possible without departing 
form the invention. Xn particular, whilst the. search or 
optimisation algorithm is described as being a hill- 
climbing algorithm, other suitable techniques could be 
used. For example, techniques from artificial intelligence 
15 could be employed for optimisation. This is equivalent to 
searching for best examples within constraints. 
Evolutionary computing techniques such as genetic 
algorithms may also be useful. In a simple sense, such 

approaches do not have specific rules for modification and 

20 may have an element of random change. Frequently a large 
population of candidates is maintained concurrently. 
These techniques do not have foinnal algorithms and take 
advantage of the increased power, i.e. memory and 
execution speed of modem computers . Accordingly, the 
25 above description of a specific embodiment is made by way 
of example only and not for the purposes of limitation. 



A- skilled person will appreciate that variations of 
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It will be clear to the skilled person that minor 
modifications may be made without significant changes to 
the operation described above. 
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Block diagram of a system for testing analogue or mixed signal circuits 




Figure 3 Fault free response (t) . faulty response a:, (/), negative part of their 
• product y(t) and their one-bit quantised responses 




Hgure 4 Block diagram of measuring the difference between a good & a faulty CUT 




Figure 5 Companding effect on the analogue responses 




so 100 ISO 200 250 

Time samples 



Figure 6 Valid analogue response due to tolerances 
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Kgure 7 Example of the tolerance limits fonction with comparator set at zero 
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Figure 8 Maximum, nominal and minimum envelops of the tolerance responses 
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Figure 9 Block diagram of a system for measuring the composite Figure-of-Merit 




Scan all possible values of 
the comparatdr threshold 



Reduce step size 














No 



Simulate & calculate 
the Rgure-of-Meiit 






Keep the change of 




the best improvement 




A 




Yes 





Figure 10 Simplified flow chart of the optimisation algorithm 




Figure 12 Simplified 3D representation of search space for binary sequences with 
only two runlengtfas showing two optima 




Figure 13 A circuit diagram of a low pass filter, used as exemplar 
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Figure 14 Frequency response of the exemplar low pass filter 

(a) Fault-free (all components are with nominal values) 

(b) Worst case tolerances (all possible combinations of component 
values their extreme tolerance) 

(c) The 22 faulty circuits (single fault at a time) 
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Figure 15 Time domain responses for a fault free and a faulty CUT (Rl+30%), 

without tolerances 
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Figure 16 Simulation results for 22 faults in the exemplar low pass filter, without 

tolerances 
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Figure 17 Examples of test signal and its responses for gain measurement of the CUT 
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